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, Abstract In the present paper we investigate the problem of the existence of a value for differential games 

i^H ■ vi^ithout Isaacs condition. For this we introduce a suitable concept of mixed strategies along a partition of 

■ the time interval, which are associated with classical nonanticipative strategies (with delay). Imposing on 
the underlying controls for both players a conditional independence property, we obtain the existence of the 
value in mixed strategies as the limit of the lower as well as of the upper value functions along a sequence of 
partitions which mesh tends to zero. Moreover, we characterize this value in mixed strategies as the unique 

^ ' viscosity solution of the corresponding Hamilton- Jacobi-Isaacs equation. 

■ 1 Introduction 

fSJ ■ In the present work we consider 2-person zero-sum differential games which dynamics is defined through the 

. doubly controlled differential equation 

sG[t,r], (1.1) 
K> . and which pay-off functional is described by 

J--=9{Xt). (1.2) 
The initial data [t^x) are in [0,r] x i?''. Given two compact metric control state spaces U and V, the both 
players use control processes u — (us) and v = (vg) with values in U and V, respectively. They control the 
state space process X — (Xg) which takes its values in i?''; its dynamics is driven by a bounded, continuous 
function / = {f{t,x,u,v)) : [0,T] x R'^ x U x V ^ R"^ which is Lipschitz in x, uniformly with respect 
to {u,v), and the terminal pay-off function g : R'^ — > i? is supposed to be bounded and Lipschitz. Under 
these assumptions on / the above equation has a unique solution X — {Xs)s^[t^T]7 denoted by X*^^"'" in 
order to indicate the dependence on the initial data (t,x) and the control processes u = (ug) and v = (vg) 
chosen by player 1 and 2, respectively; and for the associated pay-off functional we write J{t, x; u, v). While 
the objective of the first player consists in maximizing the pay-off at terminal time T, the second player's 
objective is to minimize it. 

One important issue in the theory of 2-person zero-sum differential games is the study of conditions 
under which the value of the game exists, i.e., under which the lower and the upper value functions of the 
game coincide. Indeed, with an appropriate concept of strategies, which will be introduced in Section 2, two 
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value functions can be introduced, the lower and the upper one. For the case of a deterministic differential 
game with dynamics and pay-ofF (|1.2p the lower value function V : [0,T] x and the upper one 

U : [0, T] X R"^ are defined as follows: 

V{t, x) = sup„inf/3 J(t, X, a, U{t, x) = inf/gsup^ J(t, x, a, /S), {t, x) € [0, T] x R"^, (1.3) 

where a runs the set of admissible strategies for the first player, and /3 those for the second one. Given such 
a couple of admissible strategies (a,/3), we define the associated pay-off functional J{t,x,a, 13) through the 
unique couple of controls {u,v) such that a{v) — u and P{u) = v : J{t,x,a, /3) :— J{t,x,u,v). 

In the literature, since the pioneering works of Isaacs, there have been many works showing the 
existence of the value of the game, this means the equality between the lower and the upper value functions, 
under the so-called Isaacs condition saying that, for all {t,x,p) £ [0,T] x i?'' x R'^, 

sup„e;7infi,ev/(i, x, u, v)p = infi,eysup„g[;/(t, x, u, v)p. (1.4) 

Moreover, under this condition (II. 4p the value function V{= U) solves a partial differential equation, the 
so-called Hamilton- Jacobi-Isaacs equation. Such an existence result for the value was obtained in [13] in the 
context of nonanticipative Varaiya-Roxin-EUiot-Kalton strategies, see [12], [19] and [21], and also in [2], [7] 
and [IHI, but here for differential games with constraints. As concerns the context of positional strategies, 
we refer to [16| for similar results. 

For 2-person zero-sum stochastic differential games the existence of a value was obtained in |14j and 
later revisited and generalized in [6] . We also refer the reader to [5] and the references therein for an overview 
and a more complete description of these approaches. 

Our main goal in the present paper is to investigate the problem of the existence of a value without 
Isaacs condition. Having other approaches in the classical theory of differential games in mind, it is not 
surprising that we need a proper, suitable notion of mixed strategies. This proper notion of mixed strategies 
related with a suitable randomization allows to show that the lower and the upper value functions defined 
in mixed strategies coincide. Moreover, we prove that the value in mixed strategies V = {V{t,x) = U(t,x)) 
solves in viscosity sense the Hamilton- Jacobi-Isaacs equation 

^Vit,x)+Hit,Vit,x),V,V{t,x)) = 0, it,x)e[0,T]xR^, ^^^^^ 

V{T,x) = g{x), xeR'^, 

which Hamiltonian is given by 

H{t,x,p) := inf^eAvsup^g^y / / f{t,x,u,v)^i{du)v{dv)p, {t,x,p) € [0,T] x R'^ x R'^. (1.6) 

Here AU and AV denote the set of probability measures on the set U and V (equipped with the Borel 
(T- field), respectively. It is worth pointing out that the supremum and the infimum in (II. 6p commute due 
to the classical minmax theorem. This commutation between the supremum and the infimum in (jl.6p 
constitutes also the key in the proof of the existence of the value in mixed strategies; it can be regarded 
as an automatically satisfied Isaacs condition concerning AU and AV interpreted as control state spaces. 
Having this in mind one could immediately define mixed strategies as nonanticipative strategies with delay 
for controls taking their values in AU and AV, respectively. This would lead to the same value of the game, 
given by ()1.5|) . 

But proceeding like that would mean to use relaxed controls. However, being interested in strong 
controls, i.e., controls taking their values in the given control state space U and V, respectively, we define 
controls and strategies, where the randomness-necessary for defining the concept of mixed strategies-appears 
in the choices of the players and not in the values of the controls. In this sense our work can be considered 
as an extension of the famous Kuhn Theorem for repeated games ( cf [17 and also .1 ) to the context of 
deterministic differential games. 
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To the best of our knowledge, the existence of the value for differential games without Isaacs condition 
was only investigated in the case of positional strategies in [TB], but with different techniques. Moreover, the 
nonanticipative strategies used in [2l [3 [18] do not allow to write the game in a normal form (i.e., to play a 
strategy of one player against a strategy of the other one) and, consequently, they are not appropriate for 
the definition of mixed strategies. Here in our work we use the concept of nonanticipativity with delays (see 
[H[S] and [S]) and we define a corresponding notion of mixed strategies. 

Let us explain the organization of the paper and link it with some explanation concerning our approach: 
Section 2 is devoted to some preliminaries. We introduce there, in particular, the underlying filtered probabil- 
ity space (ri, J-", F = {'^j)j>ij P) which we use for the randomization of the controls and the strategies. Given 
an arbitrary partition 11 of the interval [0,r], we introduce the admissible controls for both players along 
this partition 11 and the corresponding nonanticipative strategies with delay (for short NAD-strategies) . The 
specificity of the choice of our admissible controls along the partition H ~ {0 = to < ■ ■ ■ < tn — T} consists 
in the fact that, given the available information J^i at time ti, the admissible control processes for player 1 
restricted to the time interval [^^,^^+1) are independent of those for player 2. This conditional independence 
of the control processes on subintervals defined by the partition 11 turns out to be the crucial element in 
our approach. We show that, along the partition 11, for every couple of NAD strategies a, (3, there exists a 
unique couple of admissible controls u, v of player 1 and 2, respectively, such that a{v) — u and /3{u) — v. 
This allows to give a sense to the pay-off functional J(t, x; a, P). Since the admissible controls are random, 
also the pay-off functionals are random, and so are, a priori, and U^, the lower and the upper value 
functions along the partition H. In Section 3 we show that and satisfy along the partition 11 the 
dynamic programming principle. This principle allows to prove with the help of a backward iteration that 
and are deterministic. For this a key result is that and are invariant with respect to a 
certain class of bijective transformations r : £7 —> f2 which law is equivalent to the underlying probability 
measure P, combined with a statement saying that any random variable with such an invariance property 
has to coincide P-almost surely with a constant. The proof extends an idea coming from [6|, where it was 
developed for a Brownian framework. Furthermore, the fact that and are deterministic, allows to 
prove that 

V^{t,x) ^supJnfpE[J{t,x,a,P)], U^{t, x) = Mpsup^E[J{t, x, a, /3)], {t,x) e [0,T] x R'^, (1.7) 

where a runs the set of NAD-strategies along 11 for the first player, and /3 those for the second player. This 
combined with standard estimates yields that and are jointly Lipschitz in {t,x), with a Lipschitz 
constant which does not depend on the partition 11. From there we deduce in Section 4 that the lower 
and the upper value functions and converge uniformly on compacts to the unique solution of the 
Hamilton- Jacobi- Isaacs equation (jl.Sp . as the maximal distance |H| between two neighbouring points of the 
partition H tends to zero. Consequently, the limits of and U^, V :— lim|n|^o ^^^d U := lim|n|^o 
exist and coincide: V = U is the value in mixed strategies of the game. 

2 Preliminaries 

Let X2{dx) = dx denote the two-dimensional Borel measure defined on the quadrate [0, 1]^ C endowed 
with the Borel field S([0, 1]^). Denoting by N the set of all positive integers we introduce our underlying 
probability space (fi, J^, P) as product space 

in,T,P) :=(([0,l]T,S([0,l]T^Af«), 
i.e., Q = {(jj = {ujj)jyi \ g [0,1]^, j > 1} is the space of all [0, 1] ^-valued sequences, endowed with the 
product Borel-field T — B{[0,1\'^)®^ and the product probability measure P = Xf^. Moreover, letting 
Q = (Cj,i, 0,2) : — 5- [0, 1]^ denote the coordinate mapping on 51 : 

= (0,1 (^^), 0,2 (t^)) = (a;j,i,Wj-2), uj = ((wj-i,a;j,2))j>i G 
we have that is the smallest cr-field over fl, with respect to which all coordinate mappings 0, J ^ 3,re 
measurable. In what follows we will also need the cr-fields Gj := Ou (S([0, 1])) = G F} | F e B{[0, 1])} 
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and T-Lj Cj l{B{[Q, 1])) generated by and Cj\2, respectively, j > 1, as well as the cr-field 

a {\J^<J{Q^ U H^)} = 1 < * < j}, 

generated by the coordinate mappings Ci, . . . , (j-, for j > 1. We remark that, for all j > 1, the cr- fields Gj,'Hj 
and J-j-i are independent. Moreover, F — {J'j)j>i forms a time-discrete filtration, and J- = \/j>iJ'j {■= 
o'{Uj>i7v,} ). We also recall that a random time t : il ^ {0, 1,2,...} is an F-stopping time, if {r = j} G 

Let U and V be compact metric spaces; by AU and AV^ we denote the space of probability measures 
on {U,B{U)) and on {V,B{V)), respectively. The fact that all probability measure /i G AU {v e AV^, resp.) 
coincides with the law of a suitable JJ-valued random variable (1^- valued random variable, resp.) defined over 
the space ([0, T], i3([0, T])) endowed with the one-dimensional Borel measure (it's an elementary consequence 
of Skorohod's Representation Theorem, refer to pp 70 in |3]), implies, in particular, that 

Au = {p^\ie L%n, g,,P; u)fi Av = {p^ I e e L'^in, nj,P; [/)}, J > 1. 

In order to introduce the dynamics of the controlled system we want to investigate, we shall begin 
with defining the admissible controls for the both players. We define them along a partition 11 of the time 
interval [0,r]. 

Definition 2.1. (admissible control) A process u G i!^(0,r;L/f| is said to he an admissible control for 
Player 1 along a partition 11 = {0 = to < < • ' • < in — of the interval [0, T], if, for any j (1 < j < n), 
its restriction W|[tj_i,t^) to the interval [tj_i,tj) is of the form j^-, — J2k>i k'^'''^ ' "where {Tj^k)k>i C 

J-j-i is a partition of ft and {u^''^)k>i C Lg ,{tj-i,tj; U). If this is the case, we write u S U^j,. 

Similarly, we say that v £ Ljr{0, T; V) is an admissible control along the partition U for Player 2, if for 
any j (1 < J < n), its restriction f^.j to the interval [tj-i, tj) is of the form v^[t^_^t.-) — X]fe>i -^r^ k^''"'^ i 

where {Tj,k)k>i C -Pj-i is a partition of and {v^'^)k>i C L^,[tj-i,tj;V). If this is the case, we write 

V G Vo^T- 

Finally, for < t < ti £ li, we put 

- {K).G[t,t,]|w e K,t} V", e Kt}- 

Let us describe now the dynamics of our differential game along a partition 11 of the interval [0,r]. 
For this we consider a bounded continuous function / = {f{t,x,u,v)) : [0,T] x x U x V — > R'^ which 
is supposed to be Lipschitz in x, uniformly with respect to {t,u,v). Given initial data {t,x) e [0,T] x 
and two controls u e Uf^rp and v G V^^^^, we define the continuous process X*'^'"'" = (-'i^s'^'"''')se[t,T] as the 
unique solution of the following pathwise differential equation: 

Xl'^'^^^^x+j /(r,X;■"■"'^u„w,)dr, se[t,T], (u,v) (.U^^ ^ ^fr- (2-1) 



We remark that standard estimates show 



Lemma 2.1. For a suitable real constant C independent of the partition H we have, for all (u, v) G lAj^rpXVj^rp, 
for all {t,x),{t',x') g[0,T]x R"^ and all s e[t\/t',T], 



(i) \Xl'-'-'- -x\< CT, 

(ii) IXl'""'"'" - < C{\t - t'\ + \x~ -"^ ^ ' ' 



Let g : i?*^ — > i? be a bounded Lipschitz function. For a game over the time interval [t, T] along the 
partition H = {0 = to < < ■ ■ • < = T}, with < i < n — 1 such that ti < t < ti+i, we consider 
the payoff functional E[g{x!ji'^'"'^)\J-i] which Player 1 tries to maximize through the control u € I^^t and 
Player 2 tries to minimize through his choice of w G ^Y^t- However, in order to guarantee the existence of 
a value of the game, we consider a game in which both players use non-anticipative strategies with delay 
(NAD-strategies). 



^As usual, L^(Q,,Qj , P;U)} denotes the space of all (7-valued random variables defined on {yi,Qj , P). 

'^L°,{0,T;U) denotes the space of all measurable (7-valued processus u = (^'t)tg[o,T] such that ut is J^-measurable, for all 
t£[0,T]. 



Definition 2.2. (NAD-strategies) Let H = {0 = to < ti < ■ ■ ■ < tn = T} be a partition of the interval [0, T] 
and < t < ti Q H. We say that (3 : U^ti — ^ ^tV '^^ NAD-strategy for Player 2 over the time interval 
[t, ti] along the partition H, if for all ^-stopping time r : Q, ^ {0, 1, . . . , n — 1} and all controls u, u' e U^^^ 
with u = u' , dsdP-a.s. on [[t,tr]^, it holds I3{u) = P{u'), dsdP-a.s. on [[t^tr+i]]- The set of all NAD-strategy 
for Player 2 over [t, ti] along H is denoted by B^t^ ■ 

In an obvious symmetric way we also introduce for Player 1 the set of all NAD-strategies over the 
interval [t^ti] along li, and we denote it by J^tr 

The following result is crucial; it permits to associate couples of NAD-strategies with couples of admissible 
controls. 

Lemma 2.2. For all couple of NAD strategies {a, (3) G •^f^ti ^ ^^u^ there exists unique couple of admissible 
controls {u,v) G l^t^ti ^ '^?ti such that a{v) ~ u, (3{u) — v, dsdP-a.s. on [t,ti] x f2. 

Although such a result is well-known for deterministic and stochastic differential games (see, for 
instance, |4] and [5]), we want to sketch here the proof for the convenience of the reader, because the context 
we study differs a bit from that of and [5]. 

Proof Let n = {0 = to < ^1 < • • • < = r} be a partition of the interval [0,T], < ti < t < tt+i <ti e II, 
and (a,/?) G A^^t^ x S^t, ■ Then, due to the definition of NAD strategies, a(u),/3(w) restricted to the interval 
[t, ii+i] depend only on the restrictions of the controls v G Vj^f^ and u G l^l^ti the interval [t, ti]. But since 
this interval is empty or at most a singleton (and, hence, of Lebesgue measure zero), a{v),/3{u) restricted 
to the interval [t, ti+i] don't depend on v and u. Consequently, given arbitrary G i^t^ti i ^ ^t^ti i Pu^t 
:= a{v^),v^ := l3{u^), and we have 

a{v^) = u^, (3{u^) = v^, on [t,ti+i]. 
Supposing that we have constructed (w^~^, v^~^) G i^^ti ^ V^^^^ such that a{v^~^) — u^~^ and f3{u^~^) — 
v^^^, dsdP-a.s. on [t,ti+j^i], we put :— /3(w-'~^), v^ := a{u^~^). Then, obviously, {u\v^) G Uf^i^ x Vf^^^, 
{u^,v^) = {u^~^ ,v^^^), dsdP-a.s. on [t,ti+j^i], and because of the NAD property of the strategies a, (3 we 
have — /3(w-'), — a{u^), dsdP-a.s. on [t,ti+j]. By iterating the argument up to j = / — i we obtain the 
assertion of the lemma. I 

Remark 2.1. Given a couple of NAD strategies {a, (3) G A^ti ^ B^ti the above Lemma \2.2\ allows to define 
the dynamics X*'^'"'^ = (A^s'^'"'^)sg[t,t,] along the partition H over the interval [t,ti] (ti G Ilj through that 
of the couple of admissible controls {u, v) G l^t^n ^ ^?ti associated with by the relation a{v) — u, f3{u) = v, 
dsdP-a.s. on [t,ti\ x f2. 

After the above preliminary discussion we can now introduce the value functions of the game along a 
partition li ^ {Q = t^ < ■ ■ ■ < tn = T} oi the interval [0, T]. For the initial data {t, x) G [0, T] x we define 
the lower value function V and the upper value function U along a partition li = — t^ < ■ ■ ■ < tn — T} 
as follows: 

V^it^x) esssup„g_4n essinf^ggn £'[5(X^'''"''^)|j;], 

C/n(i,x) := essinf^ggn^^esssup^g^n^^ £'[5(X^'''"'^)| J",], (2.3) 

for t, <t < t,+i <T (0 < i < n - 1). 

We emphasize that, since the lower and the upper value functions are defined as a combination of 
essential supremum and essential infimum over an indexed family of uniformly bounded, J^^-measurable 
random variables, also they themselves are a priori bounded, J-i-measurable random variables (Recall the 
definition of the essential supremum and infimum, e.g., in Dunford and Schwartz Dellacherie |10j or 
in the appendix of Karatzas and Shreve |15) . where a detailed discussion is made.). However, in the next 
section we will show that the lower and the upper value functions are deterministic (The interested reader 

^The stochastic interval [[t, t-f]] is defined as {{s, lu) G [t, T] X Q \ t < s < 
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is also referred to [6], where a comparable approach, but in a completely different framework is done for 
stochastic differential games with Isaacs condition.) 

We also remark that we have the following statement as an immediate consequence of Lemma l2.1l and 
the fact the the function g is bounded and Lipschitz: 

Lemma 2.3. Under our standard assumptions on the coefficients f and g we have that there is some constant 
L such that, for all {t, x), {t' , x') G [0, T] x R'^ and for all partition 11, 

{W{t,x)\<L, 

iu)\V^it,x)~V^{t,x')\<L\x~x'\, P-a.s. ^ ' ' 

3 Lower and upper value functions along a partition 

The objective of this section is to study the properties of the above introduced lower and upper value 
functions along a partition 11 = {0 = to < < ■ • • < = of the interval [0,T]. More precisely, we first 
establish a dynamic programming principle (DPP) which on its part will allow to prove that the both value 
functions are deterministic. 

Theorem 3.1. (Dynamic Programming Principle) Let 11 = {0 = to < • ' • < = he an arbitrary 
partition of the interval [0, T] and {t, x) G [0, T] x R"^. Then, for i, I such that ti < t < < ti, 



U^{t,x) = essinf^ggn^ esssup^g^n^ E[U^{ti, Xlf''^''^) \ J",], P-a.s. 



For the proof which will be split in two lemmas, we will restrict to the lower value function along a 
partition; the proof for the upper value function along a partition uses a symmetric argument. Keeping the 
notations introduced in the above theorem we put 

Vl'{t,x) - esssup„e^n^^essinf^gBn^^ii;[l/n(tz,X*;"^"'^) | J",]. (3.2) 

We remark that Vi^{t,x) is an J-i-nicasurable random variable. 

Lemma 3.1. Under our standard assumptions we have Vi^{t,x) < V^{t,x), P-a.s. 

Proof. Step 1. Let us fix arbitrarily e > 0. Then, there exists af G -^^^ti such that 

Vi^it,x) < essinf^^ggn E[V''{U,xlf^''^''^') \ T,]+e, P-a.s. (3.3) 

Indeed, setting Ii{a) — essinf^^^^n E[V^{ti^ X^'^''^'^^'^) \ J^j], we know from the properties of the essential 
supremum over a family of random variables that there is a countable sequence {ak)k>i C ^t't, such that 

Vi^{t,x) = esssup^ g_4n /i(q!i) = sup;,>;^/i(afe), P-a.s. (3.4) 

Then, obviously, Afc := {Vi^{t, x) < h{ak) + e} & Fi, k> 1, and putting Pfc := \ (U,<fc Ai), A; > 1, we 
define an ($7, J-"i)-partition, i.e., a partition of fi, composed of elements of the cr-field J-^. Let us now introduce 
the mapping a\ := I]fc>i/r^afc(-) : Vf^i^ ^^t^t, - I* can be easily checked that such defined mapping belongs 
to Af^f.^, and standard arguments (see, e.g., [B]) allow to show that 

ii;[l/n(t,,4'^^"-^^) I J-,] =Y,Ir,E[V''{ti,xlf'''''^') \ j:,], for aU f3, G S^,. 

Therefore, again for all (3i G Spj^ , 

Vi''{t,x)<j:k>JrM(^k)+e 



< Y,lT,E[V''{ti,Xlf'"'"^-) I H+e = E[V^{ti,xlf'''^-'^') I F,]+e. 

k>l 



Given now an arbitrary /3 G and any U2 € Ujj rp we make the following particular choice of fSi : 

/3i{ui){s) ■.= l3{u){s),se[t,ti], uieUjlt,, 

where 

N / Ms), s e [t,ti] 

^ ^ ■ I U2{S), s&{U,T]. 
Abbreviating, in what follows we will write for such a process composed over different intervals: 

U = Ul®U2, /3l(ui) = ^(Ul © U2)|[t,t,]- 

We observe that /3i € ^Y^ti, ^ consequence of its nonanticipativity property, it is independent of the 
particular choice of U2- Consequently, 

Vl'it.x) <e + E[V^{tuXlf'''''^^') I ^-a.s., (3.5) 
for our particular choice of /3i , since we have seen that this relation holds true for all /3i S Sp^^ . 

Step 2. Let us now continue by discussing the expression V^{ti, xl'^^'"^'^^ ) inside the above conditional 
expectation in p.Sp . For this end we consider a partition (Oj)j>i of W^, composed of nonempty Borel sets, 
such that, for all j > 1, the maximal distance between two elements of Oj is less than or equal to e. Let us 
fix in all Oj an arbitrary element yj . 

In analogy to Step 1 we see also here that, for every j > 1, there exists aj'"' S A]^^ rp such that 

V''iti,y,) = esssup„^g^n^^essinf^^gen^S[5(^T*'""^') I ^i] 
< e + essinf^,ggn £;[g(X^'^-"="'^^) | J",], P-a.s. 

In dependence of our (3 G B^rp already chosen in the preceding Step 1 we want to make now a particular 
choice of & ^?,,t- For this end we notice that, since {a\,Pi) € A^^^^ x Bf^^^, due to Lemma [2?2l there 
exists a unique couple {ul,vl) G U^i^ x V^^j, such that af(vf) = uf, and (3i{ul) = vf. With the notations 
introduced in Step 1 we define now 

I32{u2) := /3(uf ©U2)|[t,,T], U2 e Uj^^r- 
It is straight-forward to check that /3i € B^^ j,, and, consequently, 

V^{U,y,) < £ + I Ti], P-a.s. (3.6) 

Thus, from the Lipschitz continuity of V^{ti, .) (see Lemma l2.3p we obtain 



<(C + l)£ + ^/^^,.,„5,,,^^^ji?[g(X^*'"^'^'^^)| J-,]. 



(3.7) 



Let us introduce now a2 ■= / I, t.m.aj ,/3i ^'^2''' ■ 1^ easy to verify that belongs to A^ t- 

other hand, for every (q!2'"',/32) G ^ x SJJt-, there exists a unique couple (uj'"*: ^2'"') ^ ^t^T ^ H'^T' such 
that 

"2'^ ("^2'^ ) = ""2'^ . ^2 (M2''' ) = ^^2'^ 

and with its help we define 

(k. ^, 

i>i 

Then, according to the definition of a| and the nonanticipativity of the elements of ^ (see Definition 
for nonanticipative strategies), since = '^2^ on ^ Q^.j x [i/,T], we also have 

a\{v^) = arivl) = c^'iv^') - uf,-' = u?, on {X*'^'"-''^ G O,} x [U,T], j > 1. 
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Consequently, since {Oj)j>i forms a partition of W^, it holds = u^. Analogously, we obtain P2{ul) = 

v|. Moreover, recalling that (uf , ) G A^t^ x 'Bj^t, has been introduced such that af (wf ) = , = wf, 

we define a couple of controls (u^, v'^) € Uj^rp x Vj'^y by putting := itf ©1*1 ^-^d v'^ := ® Furthermore, 
we introduce 

a^v) := al{vi) ®a^^{v2), for vi := W|[t,t,], W2 := vi[t,,T], v € V"t- 

Then € ^Ptj ^^"^ a^(u'^) = aKvl) © Q!2(i'2) = © = ^^d, on the other hand, recalling the 
definition of /3i and /32, we have 

= /3(u^ © ©/3K©^) |[t,^T]=/5iK)©/32K) = i;^©iil = 1^". 

This shows that {u^,v'^) S i^^^j^ x V^rp is the unique couple of controls which is associated with (a^,/3) € 
Af-'p X Bfrp. Hence, 

and, taking into account in addition the Lipschitz property of g , we get 

, , , 3.9 



Consequently, from (|3.7p and 

yn(<,,X*;"'"^'^^) < Ce + I J-z], P-a.s. (3.10) 

Furthermore, from (13. 5p . 

yn(i,x) < £ + i?[yn(<,,4'"'"-''^) I J-,] < C£ + i?[5(X^'"'"'''') | P-^-S- (3.11) 

This relation holds true for our arbitrarily chosen and, hence, for all (3 G -BJ^t- It follows that 

Vi^{t,x) < Ce + essmif^^sn^E[g{X*j,''-°'^''^)\Ti] 

< Ce + esssup„g_4n^ essinf^ggn^ E[g{X^^'"'^) \ Ti] (3.12) 
= Ce + V^{t,x), P-a.s., 

and the statement follows by letting e tend to zero. I 



Let us now come the converse statement to Lemma 3.1. 
Lemma 3.2. Under our standard assumptions we have Vi^{t,x) > V^{t,x), P-a.s. 

Proof. Because of the symmetry of some arguments to those in the proof of Lemma 3.1, this proof here will 
be kept shorter. 

Let us fix any a G A^rp and, for some arbitrarily chosen V2 G Vti.T, we put ai(wi) := a{vi ©U2) ||[t,t,)j 
vi G Vt.t, . Obviously, such defined mapping ai belongs to A^ti and, as a consequence of its nonanticipativity, 
it doesn't depend on the choice of V2. Thus, from the definition of V[^{t,x) it follows that 

Vi^{t,x) > essinfo gn E[V^{ti, Xlf'"''^'') \ J",], P-a.s., (3.13) 
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and, similarly to (I3.5p . we can show that, for any given e > 0, there exists some /Sf S Bf^^^ such that 

Vi''it,x) > E[V''iti,xl;^-'''-^^')\T,]-e, P-a.s. (3.14) 

In analogy to the proof of Lemma 3.1 we discuss now the expression V^{ti,xl'-''"'''^'') inside the above 
conditional expectation in p.l4p . For this we let (uf , ) S U^^^^ x Vj^^^ denote the unique couple of admissible 
controls associated with (Q;i,/3f) g A^.t^ x B^ti by Lemma [221 i-e., such that ai{vi) = wf, /3i(uf) = vf, 
and we introduce the NAD-strategy q;| G Af^ rp by putting Q!2(w2) := Oi{vl (B V2) \[t,,T]: ^2 G V^^^-. In order 
to construct an appropriate NAD-strategy /3| S SJ^.tj '^^ Borel partition {Oj)j>i and the sequence 

Uj G Cj, j > 1, introduced in the second step of the proof of Lemma 3.1. Choosing e SJJt such that 

V^iU,y,) > essinf^,,gn 

> )|J-,]-e,P-a.s.,j>l, 
we define /Sf G '^t^.T ^^^^ /^"^ ^ B^rp by putting 

/?! ("2) := E^IX'- — ^^2 e <,T, 

j>i ^ (3.16) 
^^(u) := /?i(ui) ©/3|(u2), ui U|[t,t,)' "2 := U|[t,,T], u G ^lt- 
Consequently, taking into account the Lipschitz property of V^{ti, .) and using (|3.15p . we have similarly to 
Step 2 of the proof of the preceding Lemma 3.1 

V^n(t,x) > E[V^iU,xl';''''^''^^)\T,]-s 

> |:i^[/^,.....,^,^.j5(X^''-"^^^^^'^)l-^.] - Ce (3^^^^ 
j>i ' 

> £;[g(Xj; ' ')|J-,] -Ce, P-a.s. 

Let (^2;^!) ^ ^t^T ^ unique couple of controls associated with (q;|,/3|) G -^t^ t ^ '^t^T t>y 

Lemma [2.21 Then, it is straight-forward to show that the couple (u^,w^) = (uf © uli^f © wl) G U^j, x V^^. 
verifies a{v'^) = u^, /^'^it'^) = u^. Consequently, 

yn(i,x) > i?[.g(4'''f'7!'""''')'-^^]"^' 

> P[g(X;' 'm-Ce 

= £;[g(X^"'"''''')|J-,] -Ce ^•^■^^^ 

> essinf^ggn^P[g(X^'^'"'^)| Ji] — Ce, P-a.s. 
Taking into account the arbitrariness of a G A^t of e > 0, we conclude 

Vi^it, x) > V^{t, x), P-a.s., (3.19) 
and the proof is complete. I 

Obviously, the proof of the DPP for is an immediate consequence of the both preceding lemmas, 
and the proof for is analogous. 

After having established the DPP for the lower and the upper value functions along a partition 
and U^, we can now show that these a priori random fields are deterministic. More precisely, we have the 
following 
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Theorem 3.2. For all partition 11 of the interval [0,T], the lower value function along a partition as 
well as the upper one is deterministic, i.e., for all {t,x) 6 [0,T] x R"^, 

V^{t, x)^E [yn(t, x)] and U^{t, x) = E [[/"(t, x)] , P-a.s. 

Remark 3.1. The above theorem allows to identify the lower and the upper value functions along a partition 
with their deterministic versions: V^{t, x) := E \V^{t, x)] and U^{t, x) := E [U^{t, x)] , {t, x) G [0, T] x R'^. 

In view of the symmetry of the arguments we wih restrict the proof to the case of the lower value 
function along a partition V^. We consider a partition of the interval [0,T] of the form 11 = {0 = to < 
• • • < tn-i < tn — T} and prove by backward iteration that the lower value function along a partition is 
deterministic. For this we note that, for the first step of the backward iteration, we have the following 

Lemma 3.3. For the above introduced partition 11 and with the above notations we have that 
V^{tn^i,x) = e.ss.sup^^_^n^_^^^e.ssinfi3^i^n^^^^^E[g{Xl2'^''''"''^)\Tn-i] 

is deterministic, i.e., V^{tn-^i, x) = E [T^'^(i„_i, x)] , P-a.s., for all x G R"^. 
Proof. A crucial role will be played by the following auxiliary statement: 

Let r : r2 — > r2, cj — > r(a;) = {T(uj)k)k>i, be an arbitrary measurable bijection which law P o [t]^^ is 
equivalent to the underlying probability measure P, such that r'(a;) :— (r(a;)i, . . . , t(cli)„_i), o; e il, is 
J-n-i — 'B(([0, l]^)"~^)-measurable, and T{uj)k — ujk, k > n,uj ^ VL. Then 

V^{t„_^,x) o T = V^{t„_^,x), P-a.s. 

Let us prove this assertion. For this we notice first that, using the equivalence between P o [t]^^ and P 
as well as the bijectivity of r, we can change the order between esssup„g_4n ^ essinf^ggn ^ and the 
transformation r (The reader interested in details is referred to the corresponding proof in ^Sj.), i.e., we have 

F"(i„_i,a;) o T = esssup„g_^n essinfog„n ( E[g{Xy^^''^'°'''^)\J^n-i] ° t) , P-a.s. 

Let us study now the expression E[g{xl2'''^'"'^)\J^n-i]iT), occurring in the above formula. For this we recall 
first that, due to the definition, for any couple of admissible control processes (u, v) S ^ H^-i t„ i there 

exists an (fi, J"„_i)-partition {rj)j>i and an associated sequence of couples of control processes {uj,Vj) e 
Ll^{tn-i,tn;U) X Ll^^{tn-i,tn;V), j > 1, such that {u,v) = J2j>i It,{u^ Since £ J^n-i, we can 
find a Borel function fj with /j(Ci, • ■ • , Cn-i) — ^Tj , J > 1- Then the relation 

proves that T^^(Fj) G J-n-ii j > 1- Hence, taking into account that the mapping r : — ^ is bijective and 
T(a;)„ — LUn, w G il, we see that also ('''^^(Fj))j>i forms an ($7, J>i_i)-partition, and 

iu{T),v{r)) = ^/r,(r) • = ^/,-,(r^) • {u^,v^) g x Vn_^,,„. (3.20) 

(Recall that is C7„-measurable and, hence, a measurable function of Cn,!; while is is H„-measurable 
and, thus, a measurable function of Cn.2-) 

On the other hand, a straight-forward application of the transformation r : S7 J7 to equation (|2.ip yields 

Indeed, the only random processes in the equation (|2.ip of the dynamics are the control processes u and v. 
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Let us now consider an arbitrary couple of nonanticipative strategies {a, (3) G -^Y^^i t„ ^ tn '^ith 

which we associate the mappings : '^tt,-i,tn ~^ ^t^-i,t„ f^r '■ ^t^_i,t„ ~^ ^ti-i,tn defined as follows: 

ar{v) = a{v{T-')){T), Pr{u) = P{u{t-')){t), 

for u e i^tl_^ tn^''^ ^ ^tl-i t„- It can be easily checked that such defined mappings are themselves again 
nonanticipative strategies: a,- G /5 € B^^_^ j^. Moreover, from the bijectivity of r it can be easily 

deduced that 

{ar\a e ^n_,,i„} = {Pr\f3 G BJ^,_,,,J = Bj^._,,t„. 

Given an arbitrary couple of nonanticipative strategics (a,/?) G x we consider the 

couple of admissible controls {u, v) G l^tl-i f„ ^ ^fl-i t„' associated with by the relations a{v) = u, (3{u) = v. 
Since r' is ^„_i-measurable and r(a;)„ = a;„, w G fi, we obtain 

On the other hand, we observe that, due to the definition of the strategies ar and (3t we have 

u = a{v) = a{v{T) o T~^), i.e., u{t) = a(w(r) o t~^){t) = a^(w(T)), 

and the symmetric argument yields v{t) = Pr{u{T)). Consequently, the unique couple of admissible controls 
associated with (q!t-,/3t-) is {u{t),v{t)), and we can conclude that 

Using this together with the fact that 

{ar\a G = A"_„t„, {I3r\(3 e St"„_„tJ = Bl_^^,^, 

we obtain 

V^{t„-i,x) o T = esssup^g^n _^ ^^cssinf^ggn (^E[g{Xl2-'''''°''^)\J^n-i\ ° rj 
= esssup^g^n _^ ^^essinf^ggn _^ ^^£;[5(X*;-"'''""'''")|7'„_i] 
= esssup^g^n _^^^^essinf^gBn _^ 

Hence, V'^{ti,x) o t = V'^{ti,x), P-a.s., and the proof of Lemma 3.3 will be completed by the following 
result. I 

Lemma 3.4. Let ^ G L^(f2, he a random variable which is invariant with respect to all measurable 

bijection t : Q Q which law P o [t]~^ is equivalent to the underlying prohahility measure P, such that 
t'{uj) := (t(u;)i, . . . , T(a;)„_i), co € fl, is Tn-\ — S(([0, V^Y'~^) -measurable, and T(w)fc = Wfc, A; > n, w G Jl. 
Then ^ is almost surely constant, i.e., ^ = E[^]. 

Proof. We begin with noting that it suffices to prove this lemma under the additional assumption that ^ 
is nonnegative. Otherwise, we can always decompose ^ as a difference of its positive and its negative part, 
and observing that both parts are invariant with respect to r on their turn we can make the proof for them 
separately. 

Given 1 < i < n — 1, j = 1, 2, let us denote by 0ij the vector of all coordinate mappings (Ci,ij Ci,2, (2,1, 
C2,2, • • • ) but without the component Then, putting ^(w) := u, uj £ ft, we can identify C = Ci,j)t 
and with this identification we can write ^(w) = ^{6ij{u),Qj{u))), co gSI. 
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Recalling that ^ > 0, let us now introduce the following J>,_i-measurable mapping ip : fl ^ [0,1] : 



(yj(w) = ¥'(6'ij(w),Ci,j(w)) 



Obviously, (f{0ij{uj), .) : [0, 1] — > [0, 1] is a continuous, strictly increasing bijection which derivative is 



(w), r)dr + 1 



s € [0, 1], w e r2. 



We now put 



Such defined mapping r : il — > O satisfies the assumptions of the lemma. Indeed, due to the definition r is a 
bijection, T(w)fc = ujk, k > n, ui € fl, and r' is J>i_i-measurable. Moreover, the law P o [t]~^ is equivalent 
to the underlying probability measure P. Indeed, for any nonnegative random variable r] over {Q, P) we 
have 



E 



d 



= E 


IL 







■ E 



Jo 



where —ip(9ij,s) > 0, for all s G [0,1]. Consequently, we know from our assumption that the random 
OS ^ 

variable ^ is invariant under the transformation r, and, thus, observing that / S,{9ij{Lo), s)ds does not 

Jo 

depend on Qj{lo), we have 

E[e] + E[^]=Em + l)] 
= E[^{T)i^ + l)] = E 



= E 
= E 



= E 



^ / m,j,s)ds 



Consequently, 



from where we see that 



It follows that 



E 









[ mj,sfds 


= E[e] = E 




Jo 







E 



£,{Oij, s)ds j ds 



0. 



^= f ^{0ij,s)ds, P-a.s.,1 < i < n- 1, j = 1,2. 
Jo 

Therefore, taking into account that (, is J>i_i-measurable and iterating the above result, we get 

C = J ^(6*1,1,51,1)^51,1= J (^J C(6'l,2,Sl,2)c?Sl,2^ (6*1,1,51,1)^51,1 

= / C(si,(C2,l,C2,2,---,Cn-l,l,Cn-l,2)rfSl = •■• = / ^{s)ds, P-a.S. 

i[0,l]2 J[0,l]2("-1) 

The proof of the lemma is complete now. 
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By iterating the argument developed in the both preceding lemmas, we can prove now Theorem 

Proof. From the both preceding lemmas we see that together with V^{tn,.) := g{.) also the function 
V^{tn-i, .) is deterministic. On the other hand, from the DPP satisfied by we obtain 

T/"(t„_2,a;) = esssup„,_4n essinf^^gn £'[Fn(t„_i, Xj^:"^^'"''^)! j:„_2], P-a.s., 

for all X £ R'^. Hence, applying the argument of the both preceding lemmas again, but now for the determin- 
istic function V^{tn~i, .) instead of g (recall that due to Lemma [Ol also the function V^{tn~i, .) is bounded 
and Lipschitz), we conclude that also the function V^{tn-2, ■) is deterministic. Iterating this argument, we 
see that all V^{ti, ■) {0 < I < n) are deterministic. This implies that is a deterministic function. Indeed, 
let ti < t < ti+i. For the conclusion that the non-randomness of V^{ti+i,.) involves that of V^{t,.), it 
suffices to replace the driving coefficient f{s,x,u,v) of the controlled dynamics by f{s,x,u,v)I[t,T]{s)- This 
substitution doesn't change the values of V^{ti, x), {i + 1 < I < n) and V^{t, x), x e W^, but now V^{t, x) 
coincides with the deterministic function V^{ti, .) associated with the driver /(s, a;, u, (s). The proof 

of Theorem [22] is complete. I 

The both preceding major results, the DPP as well as the statement of non-randomness yield the 
following important characterization of the lower and the upper value functions along a partiton. 



Theorem 3.3. For all partition 11 of the time interval [0,T], and all {t,x) e [0,T] x R"^, we have 

V^{t,x) = sup„g^n^inf^ggn^S[g(X^"='"^'^)], 

U^{t,x) = inf^gBn^SUp„g^n^S[5(X^"''"''^)]. 



Proof Let U = {0 = to < ■ ■ ■ < tn ^ T}, ti < t < t,j+i (0 < z < n - 1) and x G R"^. Moreover, fix an 
arbitrary e > 0. Then, due to p. lip from the the proof of the DPP we know that there exists a'^ € A^t 
such that, for all P G ^^t^T' 

V'^it, x){^ Vl'it, x)) < E[g{X'^^^"''^) I J-,] + £, P-a.s., (3.22) 
and from (|3.18[) we get for all a € A]^rp the existence of e B^t such that 

V^{t,x){= VPit.x)) > ^[g(X^"^"'^°")|j:,] -e, P-a.s. (3.23) 

Consequently, considering that the function is deterministic and taking the expectation on both sides of 
((3:221) and jS^S]), we get 

£;[g(X^-'"'^°")] - e < V^'it^x) < E[g{X'^^'''''^) \ T.,]+e, 

for all (a,/3) g A^rp x Bf^rp. Thus, taking into account the arbitrariness of e > 0, the statement for 
follows directly, and that for can be verified analogously. The proof is complete. I 

We observe that the latter Theorem3.3 combined with ()2.2p provides directly the following statement: 

Lemma 3.5. There is some real constant L, only depending on the bound of f and the Lipschitz constants 
of f{s, ., u, v) and of g, such that, for all partition 11 of the interval [0, T] and (t, x), {t' , x') € [0, T] x R'^, 

\V^it, x) - V^it', x')\ + \U^{t, x) - U^[t', x')\ < L{\t -t'\ + \x- x'\). (3.24) 
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4 Value in mixed strategies and associated Hamilton-Jacobi-Isaacs 
equation 



The objective of this section is to show that the lower and the upper value functions along a partition V , 
converge, as the maximal distance |n„| between two neighbouring points of n„ tends to zero as n — > +00, 
and that their common limit function V is the viscosity solution of the Hamilton-Jacobi-Isaacs equation 

^W{t, x) + sup^g^yinf^eAV {l{t, x, fi, i^)\7W{t, x)j = 0; 

W{T,x) = gix), 

where 

f{x,ii,i^):= / / f{x,u,v)^[du)u[dv), /i G AC/, v ^ /S.V. 
Ju Jv 

More precisely, our main result of this section is the following 

Theorem 4.1. Under our standard assumptions on the coefficients f and g, the above Hamilton-Jacobi- 
Isaacs equation \4-l^ possesses in the class of bounded continuous functions a unique viscosity solution V . 
Moreover, for any sequence of partitions n„, n > 1, of the interval [0,T] with |n„| as n ^ +00, both 
the sequence of the lower value functions along a partition V^" as well as that of the upper value functions 
along a partition U^" , ri> 1, converge uniformly on compacts to the function V. 

The definition of a continuous viscosity solution is by now standard, and the reader interested can 
find many literatures, e.g., refer to 

Definition 4.1. A real-valued continuous function W G C([0,T] x R'') is called 

(i) a viscosity suhsolution of equation ^T7]j if W{T^x) < $(a;),/or all x G R'*, and if for all functions 
(f G C"'"([0,T] X R'') and {t,x) G [0,7") x M** such that W ^ ip attains its local maximum at {t,x), 

^ (t, x) + sup^g A[/infi.eAy x, n, v)V(p{t, x)^ > 0; 

(ii) a viscosity supersolution of equation \4-l^ (f W{T,x) > ^{x),for all x G R"*, and if for all functions 
(fi G C"'"([0,r] X R'') and {t,x) G [0,T) x R'' such that W — (p attains its local minimum at {t,x), 

^ {t, x) + sup^gAC/infi'GAy x, fj., v)Vp{t, x)^ < 0; 

(iii) a viscosity solution of equation |^.j[ ) if it is both a viscosity sub- and a supersolution of equation \4-l\) - 

The whole section is devoted to the proof of the above theorem. The proof will be split in a sequel of 
auxiliary statements. Let us begin with observing that the equi-Lipschitz continuity of the families of lower 
and upper value functions along a partition, indexed with the help of the partitions II of the interval [0,r], 
stated in Lemma 13.51 is crucial for the application of the Arzela-Ascoli Theorem. Let us arbitrarily fix a 
sequence of partitions (n„)„>i of the interval [0,T], such that for the mesh of the partition n„ it holds: 
n„| — > as n — > -t-cxD. Then we have 

Lemma 4.1. There exists a subsequence of partitions, again denoted by (nji)„>i, and there are bounded 
Lipschitz functions V,U : [0,T] x R'^ ^ R such that {V^" ,U^") — >■ {V,U), uniformly on compacts in 
[0,T] X R'^. 

Later we will see that the function (V, U) defined by this Lemma 4.1 coincide and are independent of 
the choice of the sequence of partitions. 
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Proof. Indeed, from the Arzela-Ascoli Theorem we know that, for any compact subset K of [0, T] x and 
for any subsequence of partitions of [0,T], there exist a subsequence (IIJ^) and functions U' ,V' : K ^ R 
such that {V^" ,U^^) — >■ (y',U') uniformly on J^, as n — >■ +00. By combining this resuh with a standard 
diagonahsation argument we can easily prove the stated assertion. I 

Let us fix the subsequence (n„)„>i related with C/, V by Lemma |4. II From Lemma 13.51 we have 

Corollary 4.1. For the real constant L introduced in Lemma \3.5\ we have, for all (t, x), {t' , x') £ [0, T] x W^, 

\V{t, x) - V{t', x')\ + \U{t, x) - U{t', x')\ < L{\t - t'\ + \x^ x'\). (4.2) 

By taking into account the uniform boundcdncss of the functions V^, U^, parameterized by 11- 
partition of the interval [0, T] (Indeed, they are bounded by the bound of g.), this shows, in particular, that 
V, U G Cb([0,T] X R'^) are bounded continuous functions. We are able to prove that V and U are viscosity 
solutions of equation (|4.ip . For this let us begin with 

Proposition 4.1. The function V is a viscosity solution of the Hamilton- Jacobi- Isaacs equation J^. 

In order to prove this statement, we show in a first step that 

Lemma 4.2. The function V is a viscosity subsolution of the Hamilton- Jacobi-Isaacs equation 

Proof. Since we know that, by definition (|2.3p of , V^{T^x) = g{x), x G R'^^ for all partition 11, we also 
have V{T,x) = g(x), x e R'^. Let {t,x) £ [0,r) x R'^ and ip G Ci([0,r] x R'*) be an arbitrary test function 
such that ip{t,x) - V{t,x) < Lp{s,y) ~ V{s,y), {s,y) e [0,T] x R<^. Since V e Cb{[Q,T]; R'^) is bounded, 
we can assume without loss of generality that tp G C^([0, T] x R''), i.e., that if itself as well as its first order 
derivatives are bounded. Recall that verifying that is a viscosity subsolution is equivalent with showing 
that 

d 

— (/)(i, x) + sup^gA[/inf^eAv/(i, x, fi, v)^ip{t, x) > 0. (4.3) 

For proving the above relation we note that for any p > and M > we can find a positive integer 
rip.M such that, for all n > rip^M, 

\<p{t,x) - V^"it,x)\ < p, and V^"is,y) < ipis,y) + p, for all s e [0,T], \y\ < M. 

Indeed, recall that V^" V converges uniformly on compacts, V{t,x) = (p{t,x) and V < ip on [0,T] x R . 

Let n > rip^M, n„ {0 = tJJ < • • • < = T}, and let i ^ in he such that < t < t^+i < t\\ Then, 
from the DPP (Theorem 13. ip with respect to the partition IIji and since is bounded by some constant 
C, uniformly with respect to n > 1, we have 



ip{t,x)-p < V^"{t,x 



esssup^g^n„^ essinf^ggn„^ E[V^" (tj" , Xf^'"'^) 



< esssup^g_^n„^essinf^ggn„^£;[(^(t|",X*;'='"''^)|j;] ^^'^^ 



CP{ \Xlf^"'^\ > M\J^,} + p, P-a.s. 



However, 



P{ \Xlf''^^^\ > MIT,} < j^E[\Xtp"^^\ I J-.] < ^(|x| + TCf), 



where we have used that '"'"^l < |a;| + TCf, with C/ denoting the bound of /. Thus, by choosing 
M = Mp large enough, such that p-(|a;| + TCf) < p, and recalling the equation for the dynamics of X*'^'"'^, 
we have for n > rip (;= rip^Mp) 

—3/9 < esssup _ .n„ essinfo „n„i? (p(t]^ , Xf^'"'^) — ip{t,x)\Ti 



esssup ^ essinf«^„n„_E 



^^^{r, X;--'"''5)+/(r, X*^-^"-/^ {a, /3).)V^(r, X*^-'"-'^)jdr| J". 

' (4.5) 
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Here we have denoted by {a,/3)r the unique couple of control processes {u,v) € ZYj'^t" x Vj^^n at time r, 
associated with (a,/3) € A]^^n x B^tn by Lemma l2.2l Let us introduce the continuity modulus 



m{5) :— sup|^_t|^|j^_j.|<i- „g[/,ygy 



d 



(^'/')('', y) + f{r, y, w, v)Vip{r, y) ) - ( (^V^C^, 2:) + /(i, a:, u, v)Vip{t, x) 



d 



dr 



(5 > 0. Recalling that the function /(., .,u,w) is bounded and uniformly continuous, uniformly with respect 
to {u, v) e U X V, and that the first order derivatives of ip are bounded continuous functions, we see 
that m : — i?+ is an increasing function with m{d) 0, as (5 4- 0- Thus, taking into account that 
|^M,«,/3 < Cf\r^t\ < Cflt]" -tl r e [t.Vl], we obtain 



<m{C\t^-t\), rG[i,tr]. 
(The constant C depends on x, fixed in this proof.) Consequently, thanks to (|4.5 

-3p-(ir-t) [^v(t,a;)+™(C|tr-t| 



(4.6) 



< esssup^g_^n„ essinf^ggn„ E 



f{t, X, {a, fi)r)V'p[t, x)dr\Ti 



(4.7) 



F-a.s. 



Similarly to the argument of p.3p in Step 1 of the proof of Lemma [XT] we can show there is an NAD strategy 



aP e A\% such that 



-^p-{t^-t)[-^{t,x)+m{C\t1-t\) 



< essinf^ggn„ E 



t? 



f{t,x,{aP,P)r)Vcp{t,x)dr\T, 



(4.8) 



Thus, since V^t^ C Bf^r, (Indeed, the controls v G ^Ytj" identified with (3^ S Bf^r,, where /3^(w) := v, u G 
Uf^,^.), we obtain from (148)) that, for all v G Vj^p^, 



4p - (tf ~ t) [ -^{t, x) + m{C\t^ -t\)]<E 



t? 



f{t,x,{aP,v)r)Vip{t,x)dr\T, 



(4.9) 



Let V G Vj^/ji be now of the special form v := X]j=i+i ^j^[tyr^_^.tvt^)j G -^°(^i ^5 Then, 



/(t, X, (a'', u)r)V(y9(t, a;)dr| j; 



tvt" 



/(i,a;, «"(!;),, ej)V(^(i,x)dr|J-, 



(4.10) 



Let us put uP := a''{v) G W^'^/ii, and let i + 1 < j < L Then, due to the definition of the controls from U^^^n, 
there exist an partition {Tk)k>i C J^j-i of Q and a sequence {u'')k>i C LPg.{t\/ tj_i,t V t"; C/) such that, for 
the restriction of uP to [t V t'^_^,t V t"^), 



|[tvt"_i,tvt'') 



/c>l 



Consequently, recalling that £,j £ L°(il, Hj, P; F) and that the three cr-fields Qj,'Hj and J-j-i arc mutually 
independent, we have 
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E 



E 



E 



tvt" 



tvt" 



^/r, / £;[/(i,x,u^;,0)V(^(t,x)|J-,_i]dr|J-, 
1.^1 J tvt" , 



fc>i 



fe>i 



tvt 
tvf" 



fit, X, u, v)\7(p{t, x)P^k (dw) (8) - {Av) dr| J", 



\JuxV 



(4.11) 



Recall that f{t, x, /i, i^) := 



f{t,x,u,v)n{du)iy{dv). Hence, from (g^, and (gUI]), 



9 



-4p-(ir-<) ( ^^ip{t,x)+m{C\tf~t\) 



< E 



t? 



f{t, X, [aP, v)r)^Lp{t, x)dr\F., 



(4.12) 



< J2 (tVt;'-iVi;Li)-sup^g^y/(i,x,Ai,Fe,)V(^(i,x), 



and from the arbitrariness of the random variables £,j G L'^{fl,Hj, P;V), i + 1 < j < I and the fact that 
AV ^ {P^l^e L"{n, 'Hj,P; V), we conclude 



-4p-(tr-i) (^^^ipit,x)+m{C\tY~t\ 
I 

< {tyt] -t\/ i;'_i) • inf^gAysup^eA[//(i, a;, ^i, t^)V(^(t, a;) 

(t? - t) ■ inf^eAysup^gAC//(*> a;, '^)V(/3(t, a;). 



(4.13) 



We choose now e > arbitrarily small and we put p — e^. For n > Up large enough we can find some 
I (i + 1 < I < n), such that e < i^""* — t < 2e. Indeed, recall that the mesh of n„ converges to zero, as 



-oo. Then it follows from (14.13^ that 



d 



4(tr - ty - (tf - 1) ( -(^(t, x) + m(c|tr - ^i) 



(4.14) 



< (i" - t) ■ inf^eA\/sup^g^y/(i, x, ^, iy)Vip{t, x). 
Consequently, dividing both sides of this latter relation by tf ~ t and taking the limit as e — >■ 0, we obtain 

d 



ip{t,x) +m^„<zAvSup^^uf{t,x,^i,v)'^lp{t,x) > 0. 



(4.15) 



In order to conclude, we remark that, for all {t,x,p) G [0,T] x x R'^, the function H{t,x, iJ,,v,p) := 
f{t, X, p,, v)p is bilinear in (/i, v) G AC/ x AV^. The spaces Af/ and ISV are compact and convex. Consequently, 

mi^ei^vS\y9^^Auf{t,x,p.,v)p = sup^gAC/infi>eAy/(t, a^, {t,x,p) G [0,T] x R!^ x R^, (4.16) 

and relation (|4.3p follows from (|4.15p . The proof is complete. I 

In order to complete the proof of Proposition 14. 1 1 we also have to prove the following 
Lemma 4.3. The function V is the viscosity supersolution of the Hamilton-Jacobi-Isaacs equation j.^. _?[ ). 
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Proof. In the proof of Lemma [4.21 we have already noticed that V{T,x) = g{x), x £ W^. Let us fix again 
{t,x) G [0,r) X i?'' and consider a test function (p £ C^([0,T] x M'*) which is bounded together with its first 
order derivatives, such that V{t, x) — (p{t, x) = < ^ — 1^9 on [0, T] x R'^. In order to prove the statement we 
have to show that 

d 

Q^'fiit, x) + sup^^^ifinUeAV f{t, x, fi, v)V(p{t, x) < 0. (4.17) 
Let us suppose that this latter relation doesn't hold true. Then, there exist 6 > Q, and /i* e AC/ such that 

d 



0<S < ■^ip(t,x) +8up^^^uM^^Avf{t,x,fj.,i^)\7ip{t,x) 

u ~ 
= TTfit, x) + inf^eAV /(i, x, fi* , v)V(p{t, x) 

< -g^V{t,x) + f{t,X,fl*,v)\/ip{t,x), 



(4.18) 



for all 1/ G Ay. On the other hand, given an arbitrarily small p > and M > Cp ^(|a;| + CfT), there exists 
Up > 1, such that for all n > Hp, 

\^{t,x) - yn"(i,.T)| < p, yn"(s,y) > ip{s,y)~p, s G [0,T], \y\ < M. 

Let n > Up. Adapting the argument of the proof of the preceding Lemma 4.2 and using the notations 
introduced there, we first deduce from the DPP (Theorem 13. ip with respect to the partition n„ that 



ip{t,x) + p > V^'-{t,x) 

= csssup ^n„ essinf n„ E[V^^^{t\\Xlf'"''^)\T,] 

> esssup^g^n„^essinf^ggn„^£;[(y9(t[', X*;^'"''^)|J'i] 



(4.19) 



_cp{\xit-'^\>Am}-p 



> esssup^g^n„ essinf„ggn„ E[(p{tf , Xff"°'''^^)\J'i] ~ 2p, P-a.s 
Consequently, 

3p > esssup^g_^n„ essinf^ggn„ E 



"/ d 



(^-V5(r,X;---"''')+/(r,X;'-^"''5,(a,/3),)Vv5(r,X;^-^"'^) ) dr\T. 



and using the continuity modulus 7n(.) introduced in the proof of Lemma 14.21 we obtain 

d 



> esssup^g^n„^ essinf^ppn„^ E 



f{t, X, (a, /3)r)V(^(i, x)dr\Ti 



(4.20) 



(4.21) 



P-a.s. 



In the next step, observing that we can identify as a subset of A^t" , and choosing u G Uj^p^ of the form 



Ej=.+i ^3l[tyt-_,.twt^), with G LO(r!, g,, P; U) such that P^^ = + 1 < J < 0, we g 



:et 



ip-it?-t) { -ipit,x)~m{C\t^-t\) 



> essinf „ „n„ E 



f{t, X, {u, P{u)r))y^p{t, x)dr\Fi 



(4.22) 



P-a.s. 



In analogy to the argument of p.3p in Step 1 of the proof of Lemma l3.1l we now can construct some (5^ G B^t^ 
(depending on the control process u) such that 
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4p-{t]:-t)[-ipit,x)-m{C\tY-t\) 



> E 



> E 



f[t,x,{u,(iP{u)r))V'p{t,x)dr\T, 



(4.23) 



E 

j=i+i 



f{t,x,{i,,pP{u)r))V^{t,x)dr\T, 



We put now v :— /3f(u), and we observe that, for any i + I < j < n, the restriction of v to the interval 
[t V tj_i,t") belongs to V^'lr,_^ tj. Consequently, by definition, v\[tvtj_-^,tvt:^) is of the form v\[tvtj_-^,tvvj) = 
^^Jr^f'^, where {Tk)k>i C J-j-i is a partition of fl and Vk e . , t"; F), fc > 1 (For simplicity of 



fe>i 



notations we have suppressed in this representation the dependence on j). Thus, the independence of the 
three (T-fields Hj, Qj and Jvj„iyields 



E 



= E 



E 



f{t,x,i„pP{u\)V^{t,x)Ar\J^ 







fe>i 


Vtvt" 

J - 






E^r. 




fe>i 


Jtvt" 

J - 



fit, x, n*,P^k)y(p(t, x)dr\Ti 



(4.24) 



^ /rfcinf^eAi^(/(i, x, fi* , iy)Wifi{t, x)) | J", 



fe>i 



= {tyf;-ty t]_^) ■ mUeAvfix, ii*,v)V<p{t, x)). 
Therefore, summing up (I4.24p with respect to j and substituting the result in (|4.23p we obtain 

Ap+{tl -t)m{C\tl -t\) 
d 



dt 



ip{t, x) + inU^Avfix, p*,v)Vip{t, x) 



(4.25) 



Let now e > 0, p = and |n„| > be small enough, such that can be chosen such that | < t" — i < £■ 
Then, from (|4.25p we have 



4e^ + em{Ce) > -S. 



(4.26) 



Thus, first dividing this latter relation by e and after letting e 0, we get S < 0, which contradicts 6 > 
in (|4.18p . Therefore, our hypothesis is wrong and we have (|4.17p . The proof is complete. I 



In analogy to Proposition 14. II we can prove the following 

Proposition 4.2. Also the function U G Cb([0,T] xR'^) is a viscosity solution of the Hamilton- Jacobi-Isaacs 
equation OTTp. 



Finally, we are able to prove Theorem 14. II 

Proof. Due to relation (14.16^ we know that the bounded continuous functions V and U are viscosity solutions 
of the same Hamilton- Jacobi-Isaacs equation. On the other hand, since the Hamiltonian of this equation 

H{t,x,p) = mUeAvsup^f,Au{f{t,x,p,v)p), {t,x,p) e [0,T] x R'^ x R'^, 

is bounded and continuous, Lipschitz in z, uniformly with respect to {t,x) G [0,r] G i?'', and 
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\H{t,x,p) -H{t,x\p)\ < C\p\\x~x'\, x,x' e R'^, {t,p) e [0,T] x R'^, 

it is by now well-known, that the viscosity solution of the Hamilton- Jacobi-Isaacs equation (|4.ip is unique 
in the class of continuous functions with at most polynomial growth. Consequently, V — U. On the 
other hand, recall that we have got V and U as limit over a converging subsequence of the sequence V^" 
and fj'^", respectively, where (n„)„>i is an arbitrarily chosen sequence of partitions of [0,T] such that 
n„| (n ^ +00). Therefore, since the limit of the converging subsequence doesn't depend on the choice 
of the sequence, it follows that and converge along all sequence of partitions 11 with |n| — s> 0, and 
the limit is V = U. The proof of Theorem 14. II is complete. I 
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